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Overview 


The  objective  of  this  research  Is  to  'construct  a  theory  of 
expertise  based  upon  empirical  description  of  expert  problem  solving 
abilities  in  complex  knowledge  domains.  Our  goal  Is  to  develop  a  theory 
that  Is  representative  enough  to  encompass  both  analytical  types  of 
problem  solving  (such  as,  solving  problems  In  physics),  as  well  as  more 
spatial  types  of  problem  solving  (such  as  maneuvering  In  a  large-scale 
environment).  Our  work  In  the  past  three  years  has  proceeded  In  these 
two  directions.  A  major  interest  of  the  project  Is  to  determine  the 
extent  to  which  there  are  skills  that  are  generalized  across  domains, 
and  skills  that  are  domain-specific.  The  practical  outcome  of  our  work 
Is  the  Identification  of  dimensions  o.f  expertise  that  can  be  taken  into 
account  In  training  and  assessing  the  attainment  of  high-level 
competence. 


Analytical  Problem  Solving 


Background 

Our  research  In  problem  solving  In  physics  has  been  guided  by  the 
following  three  general  questions.  First,  In  what  ways  are  experts  more 
accurate  and  successful  at  solving  problems  than  novices?  Second,  why 
do  experts  appear  to  spend  more  time  In  elaborate  qualitative  analysis 
of  the  problem  (sometimes  known  as  Intuition  and  planning),  before 
actually  working  with  the  appropriate  equations?  And  third,  on  what 
bases  do  experts  generate  a  different  set  of  solution  processes?  In 
physics,  experts  appear  to  use  a  forward-working  strategy,  where  they 


begin  by  generating  equations  Involving  the  givens  In  the  problem 
without  much  Initial  attention  to  the  unknowns  In  the  particular  problem 
statement.  A  solution  seems  to  be  reached  automatically  as  the  Initial 
equations  Involving  the  givens  are  systematically  replaced  by  other 
equations  Involving  the  unknowns.  In  contrast,  novices'  solution 
processes  appear  more  "backward"  working,  using  more  o£  the  search 
strategies  that  have  been  Identified  In  general  problem  solving  theory; 
that  Is,  the  novice  subject  works  from  the  goal  (the  unknown  asked  for 
In  the  problem)  and  sets  up  subgoals  to  reduce  the  difference  between 
the  goal  and  the  givens  (means-ends  analysis). 

These  foregoing  three  questions  stem  from  a  primary  task  of  the 
project,  that  Is,  the  determination  of  the  processes  and  structures  that 
differentiate  an  expert  from  a  novice.  The  three  questions  listed  above 
derive  from  observations  made  in  the  literature  of  one  or  two  subjects 
(Simon  &  Simon,  1978;  McDermott  &  Larkin,  1978),  and  from  our  project 
work,  (see  Chi,  Feltovlch,  &  Glaser,  1981;  Chi,  Glaser,  &  Rees,  1982). 
Our  basic  notion  at  this  point  about  what  differentiates  an  expert  from 
a  novice  Is  that  the  way  In  which  the  domain  knowledge  (physics)  of  the 
expert  comes  to  be  structured  permits  experts  to  spend  more  time 
"planning,"  to  produce  processes  that  are  more  forward-working,  and  to 
be  more  accurate  and  efficient.  Hence,  our  empirical  research  has 
focused  at  locating  the  sources  of  expert-novice  differences  In  problem 
solving  by  Investigating  how  their  knowledge  Is  organized.  We  basically 
assume  that  there  Is  no  fundamental  difference  In  the  way  experts  and 
novices  solve  ordinary  problems,  but  In  physics,  where  their  knowledge 
varies,  processing  outcomes  Interact  with  the  knowledge  the  subjects 
have  acquired. 
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In  our  preliminary  proposal  (Pebrriary  1978),  we  attempted  to  find, 
from  a  review  of  past  work,  generalized  features  of  expert 
problem-solving  performance  that  occur  In  different  knowledge  domains* 
We  concluded  that  the  processes  of  Importance  can  be  categorized  as 
consisting  of  the  following  components:  encoding,  search,  planning, 
execution  of  solution,  and  checking.  As  planned,  the  focus  of  our  first 
three  years  has  been  In  the  encoding  stage  of  problem  solving,  and  our 
interest  centered  on  differences  between  the  experts  and  novices  in 
their  encoding  of  physics  problems.  We  reasoned  that  the  encoding  stage 
of  problem  solving  was  most  important  because  it  is  at  this  point  In 
time  that  a  problem  representation  Is  constructed.  Problem  solving 
(such  as  the  search  for  an  exact  sequence  of  equations)  then  proceeds, 
based  upon  the  representation  constructed. 

This  Influence  of  encoding  upon  solution  had  been  largely  neglected 
In  the  problem  solving  literature  in  the  past  because  problem  solving  In 
puzzle-llke  (knowledge-impoverished)  domains  with  relatively  confined 
knowledge  bases  require  the  selection  of  a  set  of  limited  operators.  In 
such  contexts,  search  (finding  a  solution)  and  planning  (ways  of  finding 
a  solution  In  the  solution  space)  requires  little  complex  construction 
of  an  Initial  representation.  Hence,  the  involvement  of  encoding 
processes  that  appear  to  be  especially  significant  In  knowledge  dooiains, 
has  not  been  elaborated. 


Summary  of  Research  Findings  In  Physics 

We  have  defined  encoding  grossly  as  the  Initial  representation  that 
the  subject  has  constructed  of  a  problem,  before  actually  coming  up  with 
an  exact  solution*  This  point  can  be  Illustrated  with  some  protocols  of 
problem  solving  that  we  have  collected  (Chi,  Glaser,  &  Rees,  Study  1, 
1982).  Examining  the  protocols  given  by  an  expert  and  a  novice  on  an 
Inclined  plane  problem,  we  can  segment  the  protocols  Into  four  major 
episodes.  In  both  protocols,  only  one  phase  of  the  entice  protocol 
(first  episode  for  the  expert's  protocol  and  second  episode  for  the 
novice's  protocol)  can  be  considered  the  qualitative  analysis  stage  of 
problem  solving,  or  problem  encoding.  It  Is  during  this  stage  of 
encoding  that  the  essential  inferences  from  the  appropriate  tacit 
knowledge  are  drawn.  In  this  particular  example,  we  postulated  that  the 
novice  failed  to  solve  the  problem  because  he  did  not  Infer  that  the 
coefficient  of  friction  Is  related  to  the  angle*  The  novice  does  have 
the  necessary  equations  to  relate  those  two  concepts,  but  does  not  have 
the  explicit  goal  to  do  so,  thus  failing  to  solve  the  problem. 


Since  only  one  small  episode  of  the  entire  problem  solving  protocol 
Is  Involved  with  the  generating  of  Inferences  and  of  relevant  tacit 
knowledge.  It  Is  not  surprising  that  In  past  work,  other  aspects  of 
problem  solving  (equation  generation)  have  received  primary  attention. 
Indeed,  these  aspects  are  the  most  prominent  feature  of  the  models  of 
problem  solving  described  by  Simon  and  Simon  (1978)  and  Larkin  (1979) 
who  have  successfully  modeled  and  simulated  the  sequence  of  equations 
that  are  generated  In  the  process  of  solution.  But  results  obtained  In 
other  work  (cf.  Hlnsley,  Hayes,  &  Simon,  1978)  as  well  as  our  own 
protocol  analyses  have  strongly  confirmed  the  Idea  that  most  of  the 


solution  process  Is  completed  within  the  first  minute  or  so  as  soon  as 
the  subject  has  "analyzed"  the  problem,  even  though  the  actual  solution 
may  take  several  minutes  to  generate.  Consequently,  our  research  goal 
In  the  past  three  years  has  been  aimed  at  magnifying  this  Initial  stage 
of  problem  solving,  by  using  a  variety  of  methodologies,  besides 
gathering  protocols  of  problem  solving.. 

Because  problem  representation  must  necessarily  be  constructed 
within  the  context  of  an  existing  knowledge  structure,  an  objective  of 
the  project  has  been  to  focus  on  the  difficult  problem  of  depicting  the 
representation  of  the  knowledge  base.  Knowing  how  the  knowledge  base  Is 
represented  will  facilitate  understanding  of  how  a  problem 
representation  Is  constructed.  Our  work  In  the  first  three  years  has 
resulted  In  an  Initial  specification  of  how  declarative  knowledge  of 
mechanics  Is  structured,  and  how  this  structure  effects  the  problem 
representation.  In  the  following  sections,  we  briefly  outline  what  we 
understand  so  far. 


Encoding  Problems  Into  Appropriate  Schemata.  Using  a  sorting 
procedure,  we  have  been  able  to  confirm  our  hypothesis  that  problem 
solving  begins  with  the  Initial  identification  of  the  appropriate  schema 
to  which  It  belongs.  In  our  original  proposal,  we  called  this  "priming" 
the  right  schema.  We  now  have  a  variety  of  evidence  to  suggest  that 
schemata  of  problem  types  do  exist.  First,  when  we  ask  subjects  to  sort 
problems,  they  can  do  so  without  any  difficulty.  Second,  both  experts 
and  novices  can  sort  problems  rather  quickly,  taking  about  30  to  45 
seconds  per  problem.  Including  reading  time.  This  suggests  that  they 
are  not  basing  their  sort  on  the  outcome  of  the  solution  .processes. 


because  solving  these  problems  generally  cakes  longer  periods  of  time. 
In  the  order  of  several  minutes.  Third,  we  were  able  to  uncover 
meaningful  underlying  structures  of  these  categories  through  both  a 
clustering  type  of  analysis  and  direct  questioning  of  the  subjects. 
Both  experts  and  novices  were  able  to  articulate  the  bases  of  their 
sorting  to  some  degree.  The  bases  of  the  experts'  categories  tend  to  be 
major  principles  of  mechanics,  such  as  the  Conservation  of  Momentum 
principle,  the  Conservation  of  Energy  principle,  and  Newton's  force  law. 
The  bases  of  the  novices'  categories  tend  to  be  literal  objects  and 
concepts  stated  in  the  problem  itself,  such  as  inclined  plane,  a  spring 
problem,  and  friction.  (For  more  details,  see  Chi,  Feltovlch,  &  Glaser, 
1981.)  Furthermore,  these  schemata  are  hierarchical  in  nature,  and  we 
were  able  to  validate  the  existence  of  a  hierarchy  through  a  procedure 
we  call  hierarchical  sorting.  This  method  requires  the  subjects  to 
further  sort  the  basic  level  categories  that  have  already  been  sorted  on 
the  first  attempt.  This  procedure  revealed  the  layers  of  embedding  that 
occur  in  the  knowledge  structure  of  the  experts  and  novices.  In 
particular,  we  found  chat  the  most  naive  novices  had  almost  no 
embedding.  That  is,  they  were  not  able  to  differentiate  their  first 
level  of  sorting  any  further.  As  skill  is  acquired,  Che  hierarchy 
develops  into  a  complex  tree  with  many  levels  of  embedding.  The  most 
advanced  experts,  however,  will  often  abandon  the  lowest  level  of 
sorting,  and  have  actually  fewer  levels  of  embedding  (see  Chi,  Glaser,  & 
Rees,  1982,  Study  4). 
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'  In  general,  our  evidence  so  far  indicates  chat  using  a  schema-llke 
framework  to  Interpret  our  data  Is  not  unrealistic*  However,  It  can 
facilitate  further  understanding  of  problem  solving  only  If  we  can  show: 
1)  that  the  organization  and  content  of  these  schemata  are  basically 
different  between  the  experts  and  novices,  2)  that  the  same  problem 
actually  elicits  different  schemata  for  the  experts  and  novices,  even 
chough  Che  Identical  words  In  Che  problem  statement  were  chosen  as 
critical  for  solution,  and  3)  that  It  is  this  difference  In  the  content 
of  the  schemata  that  causes  difficulty  In  problem  solving  for  the 
novices.  '  We  have  some  evidence  to  bear  on  parts  1  and  2,  but  no 
evidence  yet  to  bear  directly  on  part  3.  In  the  following  sections,  we 
will  first  briefly  discuss  the  two  aspects  for  which  we  have  some 
evidence  for  (parts  1  and  2)  and  then  describe  how  we  will  attempt  to 
gain  Information  about  the  third  aspect  (the  Influence  of  schemata 
characteristic  on  solution  processes)  about  which  we  have  little 
Information. 


i 


How  Schemata  Are  Elicited.  Using  various  procedures  In  different 
studies,  we  have  arrived  at  two  tentative  findings  regarding  how  the 
appropriate  schemata  are  elicited.  Our  working  hypothesis  was  that 
novices  were  not  able  to  Identify  appropriate  key  words,  l.e.,  important 
words  that  cue  the  appropriate  schema.  To  answer  this  question,  we 
asked  subjects  to  judge  how  difficult  a  problem  was  after  they  read  It, 
to  circle  the  words  or  phrases  that  helped  them  make  that  decision,  and 
to  give  reasons  why  they  thought  the  problem  was  difficult.  The  general 
finding  Is  that  the  same  keywords  are  viewed  as  Important  by  both 
novices  and  experts.  However,  experts  generally  consider  fewer  key 
words  as  Important  cues  than  the  novices,  and  the  key  words  that  the 


Page  8 


experts  Identify  as  Important  are  subsets  of  those  Identified  by  the 
novices.  There  are  very  few  Instances  In  which  experts  Identify  certain 
key  words  that  the  novices  do  not  (Study  8,  Chi,  Glaser,  &  Rees,  1982). 

If  experts  and  novices  can  pick  out  what  the  Important  key  words 
are  In  a  problem  statement,  what  causes  the  novices  difficulty  In 
solving  problems?  There  are  two  possible  reasons.  First,  key  words  In 
the  problem  statement  elicit  derived  (Intermediate)  knowledge  for  the 
experts,  and  not  for  the  novices.  For  example,  the  fact  that  a  problem 
Involves  a  "pulley  with  friction"  Implies  to  the  expert  that  "rotational 
kinetic  energy"  Is  Involved.  Such  Inferences  are  usually  not  made  by 
novices.  The  evidence  for  this  comes  from  the  reasons  provided  by  the 
experts  for  a  problem's  difficulty.  Experts  refer  to  this  second-order 
Intermediate  knowledge,  whereas  the  novices  simply  say  In  this  case  that 
a  "pulley  with  friction"  Is  Involved.  Hence,  experts  appear  to  store 
Inference  rules  In  their  memory  schemata  so  that  the  words  "pulley  with 
friction"  directly  elicit  the  additional  knowledge  that  "rotational 
kinetic  energy"  In  Involved.  Such  knowledge  links  may  be  missing  In 
novices . 

A  second  reason  for  the  effectiveness  of  experts  and  the 
difficulties  of  novices  Is  that  features  In  the  problem  statement  can 
elicit  a  chain  of  Inferences  for  the  experts  but  not  for  the  novices. 
We  consequently  postulate  that  the  schemata  that  are  activated  for  the 
experts  are  different  from  the  novices.  In  the  context  of  the  example 
we  have  just  cited,  the  expert  would  then  base  his  choice  of  the 
appropriate  schema  on  the  knowledge  "rotational  kinetic  energy,"  whereas 
the  novice  would  base  his  selection  on  the  knowledge  that  a  "pulley  with 
friction"  Is  Involved.  This  conjecture  Is  supported  by  findings  In 
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another  study  (Study  Four  in  Chi,  Feltovich,  &  Glaser,  1981),  where  we 
explicitly  asked  subjects  to  state  the  reasons  for  how  they  would 
approach  the  solution  of  a  problem*  The  reasons  provided  by  the  experts 
tended  to  be  second-order  derived  knowledge  that  was  not  explicitly 
stated  in  the  problem*  Thus,  referring  back  to  the  example,  if  a  novice 
views  the  problem  as  one  involving  a  "pulley  with  friction,"  then  he 
will  activate  either  his  "pulley"  schema  or  his  "friction"  schema,  or 
some  combination  of  both*  In  contrast,  the  expert,  based  on  the 
knowledge  that  the  problem  is  one  about  "rotational  kinetic  energy," 
will  activate  his  "Conservation  of  Energy"  schema,  which  has  embedded  in 
it  both  the  "pulley"  schema  and  the  "friction"  schema* 

Based  upon  this  evidence,  we  postulate  that  one  reason  that  novices 
have  difficulty  solving  problems  is  that  they  have  activated  only  a 
lower  level  schema,  whereas  experts  have  activated  a  higher-level 
principle  schema,  which  includes  not  only  the  lower-level  schemata  that 
the  novices  activate,  but  also  additional  knowledge  about  the  relations 
between  the  embedded  schemata  and  the  high-level  principle  schema* 


Contents  of  the  Schemata  *  Errors  in  problem  solving  for  the  novice 
can  arise  not  only  from  activating  the  "wrong"  schema,  but  also  from  not 
having  the  appropriate  content  within  a  schema,  had  the  "right"  schema 
been  activated*  In  order  to  examine  the  contents  of  schemata,  we  asked 
subjects  to  elaborate  on  schemata  that  we  think  they  may  have,  such  as 
an  inclined  plane*  Their  protocols  can  be  analyzed  in  a  number  of  ways* 
One  way  is  to  think  of  everything  the  subjects  said  as  representing 
procedures  so  that  we  can  convert  their  statements  directly  into 
production  rules*  This  can  be  done  by  converting  IF-THEN  or  IF-VWEN 


statements.  With  this  technique  of  analysis,  major  difference  between 
the  experts'  and  novices'  protocols  becomes  apparent.  First  of  all,  the 
experts'  production  rules  contain  explicit  actions,  such  as  F>MA,  or 
Fs>0;  whereas  the  novices'  productions  contain  general  actions,  such 
as  Find  Mass  or  Find  Coefficient  of  Static  Friction.  In  addition, 
novices  often  possess  a  number  of  productions  without  explicit  actions. 
For  example,  they  have  productions  containing  conditions  such  as  "IF  the 
block  Is  at  rest,"  but  would  not  have  actions  attached  to  such  a 
condition.  This  Implies  that  novices  know  what  relevant  cues  to  look 
for  In  a  problem,  but  did  not  know  what  to  do  with  them.  This  Is 

consistent  with  our  additional  finding  that  novices  can  pick  out  the 
Important  features  In  a  problem  statement.  Finally,  experts  seem  to 
know  the  conditions  under  which  physics  principles  are  elicited, 
suggesting  that  they  have  explicit  links  between  their  conditions  and 
actions . 

In  summary,  our  data  suggest  that  the  contents  of  the  schemata  of 
experts  and  novices  are  different — the  experts'  schemata  containing  more 
procedural  knowledge.  We  conjecture  that  this  difference  is  a 
fundamental  source  of  error  for  the  novices.  However,  the  problem  Is 
more  complex.  If  we  ask  subjects  simply  to  generate  the  equations  that 
they  might  want  to  use  In  a  problem  Involving  an  Inclined  Plane,  both 
novices  and  experts  generate  about  the  same  set  of  equations.  Hence,  It 
Is  more  than  a  simple  matter  of  novices  lacking  procedural  knowledge  but 
what  Is  also  Important  Is  the  linking  of  procedures  with  their 
appropriate  conditions  of  applicability  —  a  consideration  of  major 
Importance  In  training  research  and  development. 


Spatial  Skill  in  Large-Scale  Environmenta 


Our  theoretical  conception  of  spatial  skills  in  large-scale 
environments  is  that  in  many  respects,  spatial  skills  Involve  the  same 
principles  as  other  cognitive  skills.  One  of  the  goals  of  our  overall 
research  project  is  to  discover  general  principles  of  expertise  across  a 
variety  of  domains.  In  a  report  (Chase  &  Chi,  1980),  we  have  described 
in  some  detail  the  relationship  between  cognitive  skills  and  spatial 
skills.  The  most  Important  principle  of  skill  performance  is  that  skill 
depends  upon  the  knowledge  base.  In  general,  the  more  practice  one  has 
had  in  some  domain,  the  better  the  ■  performance,  and  from  all 
indications,  this  Increase  in  expertise  is  due  to  Improvements  in  the 
knowledge  base.  In  research  on  spatial  skill,  our  effort  has  been 
directed  toward  an  analysis  of  cab  drivers'  knowledge  representation  in 
large-scale  environments. 

Summary  of  Research  Findings  on  the  Representation  of  Large-Scale 
Environments 

One  of  the  current  debates  in  cognitive  psychology  is  whether 
spatial  knowledge  is  represented  as  a  visual  image  or  as  a  set  of 
propositions.  We  will  remain  theoretically  neutral  on  this  question, 
although  we  have  outlined  a  more  sophisticated  theory  based  on 
hierarchical  organization  (Chase  &  Chi,  1980).  Our  research  on 
expert-novice  cab  drivers  suggests  that  large-scale  environments  are 
organized  hierarchically.  Local  regions  are  Interconnected  by  a  network 
of  global  features.  In  the  spatial  layout  of  cities,  this  knowledge 
takes  the  form  of  a  grid  structure,  or  a  network  of  relative  spatial 
relations  with  respect  to  some  prominent  landmark.  We  have  several 
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findings  to  support  this.  First,  without  respect  to  skill,  two-thirds 
of  the  cab  drivers,  when  asked  to  draw  a  nap  of  Pittsburgh,  started 
their  drawing  with  the  river  system,  followed  by  placements  of  adjacent 
neighborhoods.  We  suggest  that  this  is  because  the  river  system  is  a 
global  feature  which  serves  as  a  reference  for  placing  the  more  local 
features  (the  neighborhoods).  Second,  cab  drivers  tend  to  recall 
neighborhoods  together  that  lie  in  the  same  larger  geographic  area  (such 
as  the  North  Side);  again,  suggesting  that  neighborhoods  are  clustered 
into  geographic  regions.  Third,  when  cab  drivers  are  asked  to  place 
neighborhoods  on  a  blank  nap  of  Pittsburgh,  their  locations  tend  to  be 
distorted  toward  the  point  at  downtown  (where  the  three  rivers  come 
together).  This  again  suggests  that  local  neighborhoods  are  represented 
in  memory  in  reference  to  some  prominent  landmark.  Finally,  when  cab 
drivers  were  given  pairs  of  well-known  locations  in  the  Pittsburgh  area 
and  asked  to  judge  the  direct  distance  between  them,  distances  were 
greatly  overestimated  for  locations  separated  by  a  neighborhood 
boundary.  This  result  is  another  instance  of  a  general  phenomenon: 
Distance  estimates  across  hierarchical  boundaries  are  greatly 
overestimated  (Stevens,  1976).  In  sum,  we  have  provided  a  variety  of 
evidence  to  support  our  notion  that  spatial  knowledge  is  hierarchically 
organized  (Chase,  in  press). 

How  is  this  spatial  knowledge  used?  We  suggest  that  there  is  a 
fundamental  distinction  between  two  kinds  of  processes:  automatic 
procedures  and  inference  rules.  In  his  model  of  spatial  cognition, 
Kuipers  (1978)  only  makes  use  of  inference  rules,  but  a  case  can  be  made 
that  people  use  automatic  procedures  as  well.  An  automatic  procedure  is 
used  when  someone  follows  a  well-  learned  route.  At  each  choice  point 
along  a  well-traveled  route,  a  decision  must  be  made  as  to  which  way  to 
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go,  and  this  is  normally  accomplished  smoothly,  automatically  and 
unconsciously.  Nevertheless,  people  must  make  use  of  some  Information 
from  the  environment  to  follow  a  route.  The  usual  suggestion  is  that 
people  use  visual  "Images"  or  "Icons."  That  Is,  people  have  visual 
knowledge  about  each  choice  point  stored  In  long-term  memory,  and  as 
they  approach  these  choice  points,  certain  visual  features  serve  to 
activate  this  knowledge;  and  associated  with  this  knowledge  are 
procedures  that  tell  people  what  to  do  next.  This  Is  exactly  the 
argument  made  In  the  cognitive  skills  literature  as  to  why  chess  players 
and  bridge  players  (Chase  &  Simon,  1973;  Chamess,  1979)  can  think  of 
good  moves,  good  evaluations,  or  whole  sequences  of  moves  or  card  plays 
rapidly  and  seemingly  unconsciously.  In  each  case,  procedural  knowledge 
Is  built  Into  long-term  memory  and  If  the  right  visual  Information 
appears,  this  knowledge  Is  activated  and  appropriate  action  Is  taken. 

We  have  some  evidence  In  support  of  the  existence  of  automatic 
procedures.  First,  when  cab  drivers  are  asked  to  Identify  pictures  of 
Intersections,  expert  drivers  can  Identify  more  Intersections  correctly 
when  these  occur  In  the  secondary  (or  non-major)  streets.  This  suggests 
that  people  do  have  visual  knowledge  about  choice  points  stored  In 
long-term  memory,  and  they  develop  greater  numbers  of  Images  of  choice 
points  with  experience  In  driving  In  the  city.  Second,  when  cab  drivers 
are  asked  to  generate  routes  In  the  laboratory  and  later  asked  to  take 
the  same  routes  In  the  field,  they  all  improved  their  routes  by  25Z. 
This,  we  conjecture,  results  from  encountering  Intersections  In  the 
field,  which  matches  the  visual  knowledge  of  their  automatic  procedures, 
and  then  triggering  known  routes  associated  with  these  cues. 
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The  second  kind  of  process  that  people  use  to  operate  on  their 

spatial  knowledge  Is  the  Inference  rule.  These  rules  are  used  to  derive 
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knowledge  that  Is  not  explicitly  stored  In  memory.  They  may  be  used  to 
fill  In  gaps  In  routes,  to  orient  oneself  In  the  environment,  to  perform 
geometric  problem  solving,  and  so  on.  Kulpers  (1977,  1978)  has  provided 
a  taxonomy  of  various  types  of  Inference  rules  for  his  model  of  spatial 
knowledge,  and  various  examples  of  Inferenclng  rules  have  been  published 
(Chase  &  Chi,  1980;  Stevens  &  Coupe,  1978).  We  have  some  data 
pertaining  to  the  existence  of  Inference  rules.  For  example,  when  cab 
drivers  are  asked  to  point  to  the  direction  of  a  specific  neighborhood, 
they  tend  to  point  In  the  direction  of  a  nearby  major  street  that  leads 
to  that  neighborhood,  suggesting  that  they  are  Inferring  the  direction 
of  the  neighborhood  from  the  direction  of  the  street  that  reaches  It. 

So  far,  we  have  summarized  results  which  suggest  that  spatial 
representation  Is  hierarchically  organized,  irrespective  of  the  skill 
level  of  the  navigator,  and  that  there  appears  to  exist  automatic 
procedures  which  both  expert  and  novice  navigators  can  use.  What,  then, 
differentiates  the  experts  from  the  novices?  Basically,  experts  have  a 
richer  knowledge  base  of  streets,  particularly  the  secondary  ones.  For 
example,  the  expert  cab  drivers  can  name  more  streets,  particularly  In 
the  less  familiar  neighborhoods.  Second,  experts  excel  at  generating 
routes  between  two  locations.  Experts'  routes  tend  to  be  short  whereas 
novices'  routes  tend  to  be  long.  Moreover,  experts  can  often  generate 
an  Improved  route  through  the  secondary  streets. 


Not  suprlslngly,  expertise  In  taxi  driving  tended  to  emerge  when 
drivers  were  asked  to  find  routes,  particularly  routes  through  the 
lesser-known  streets.  The  expert's  ability  to  name  and  recognize  more 
of  these  lesser-known  streets  than  the  novice  Is  additional  evidence 
that  expertise  Involves  a  larger  knowledge  base  acquired  through  years 
of  practice. 

The  absence  of  any  skill  effects  In  the  various  cognitive  mapping 
tasks  lends  little  support  to  the  Idea  that  taxi  drivers  navigate  by 
means  of  a  map  In  the  head.  The  results  do,  however,  suggest  that  the 
large-scale  representation  of  locations  Is  hierarchically  organized  such 
that  locations  are  nested  within  neighborhoods,  neighborhoods  are  nested 
within  large  regions  and  larger  regions  are  located  with  respect  to  more 
global  features. 

Finally,  It  Is  suggested  that  the  hierarchical  organization  of 
neighborhoods  Is  Important  In  terms  of  economy  of  storage,  and  that  this 
hierarchy  serves  as  an  Integral  part  of  planning  a  route.  Hierarchical 
storage  means  that  one  need  only  store  relative  locations  of  places 
within  a  neighborhood.  To  retrieve  the  relative  locations  across  a 
hierarchical  boundary,  one  need  only  retrieve  the  relative  location  of 
the  two  neighborhoods  and  the  relative  location  of  each  place  with 
respect  to  Its  own  neighborhood.  to  get  from  a  location  In  one 
neighborhood  to  another  location  In  a  different  neighborhood.  It  Is 
suggested  that  the  driver  first  find  a  route  that  connects  the  two 
neighborhoods,  and  then  the  rest  of  the  route  is  either  subsequently 
generated  or  It  Is  filled  In  as  the  driver  goes  along.  It  Is  this 
''fllllng-ln”  process  that  Involves  automatic  procedures.  The  driver  can 
continue  following  a  global  plan  until  cues  from  the  environment  are 
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encountered  that  trigger  specific  routes  at  choice  points  along  a  route. 
Some  such  process  as  this,  It  is  suggested,  underlies  slclll  differences, 
as  the  number  of  these  automatic  procedures  increases  with  experience. 
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Training  Technical  Area 
U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Marshall  Narva 
US  Army  Research  Institute  for  the 
Behavioral  4  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Harold  F.  O'Neil,  Jr. 

Director,  Training  Research  Lab 
Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Joseph  Psotka 
Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria.  VA  22333 

1  Dr.  Robert  Sasmor 

U.  S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Robert  Wisher 
Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 


1  H.  William  Greenup 

Education  Advisor  (E031) 
Education  Center,  MCDEC 
Quantico,  VA  22134 

1  Special  Assistant  for  Marine 
Corps  Matters 
Code  100M 

Office  of  Naval  Research 
800  N.  Quincy  St. 

Arlington,  VA  22217 

1  DR.  A.L.  SUFKOSKY 
SCIENTIFIC  ADVISOR  (CODE  RD-1) 
HQ.  U.S.  MARINE  CORPS 
WASHINGTON,  DC  20380 
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Air  Force 

1  AFHRL/LRS 
Attn:  Susan  Ewing 
WPAFB 

WPAFB,  OH  45433 

1  U.S.  Air  Force  Office  of  Scientific 
Research 

Life  Sciences  Directorate,  NL 
Bolling  Air  Force  Base 
Washington,  DC  20332 

1  Air  University  Library 
AUL/LSE  76/443 
Maxwell  AFB,  AL  36112 

1  Dr.  Earl  A.  Alluisi 
HQ,  AFHRL  (AFSC) 

Brooks  AFB,  TX  78235 

1  Bryan  Dallman 
AFHRL/LRT 

Lowry  AFB,  CO  80230 

1  Dr.  Alfred  R.  Fregly 
AFOSR/NL 

Bolling  AFB,  DC  20332 

1  Dr.  Genevieve  Haddad 
Program  Manager 
Life  Sciences  Directorate 
AFOSR 

Bolling  AFB,  DC  20332 

1  Dr.  T.  M.  Longridge 
AFHRL/OTGT 

Williams  AFB,  AZ  85224 
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Department  of  Defense 

12  Defense  Technical  Information  Center 
Cameron  Station,  Bldg  5 
Alexandria,  VA  22314 
Attn:  TC 

1  Military  Assistant  for  Training  and 
Personnel  Technology 

Office  of  the  Under  Secretary  of  Defens 
for  Research  &  Engineering 
Room  30129,  The  Pentagon 
Washington,  DC  20301 

1  Major  Jack  Thorpe 
DARPA 

1400  Wilson  Blvd. 

Arlington,  VA  22209 
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Civilian  Agencies 

1  Dr.  Patricia  A.  Butler 
NIE-BRN  Bldg.  Stop  #  7 
1200  19th  St.,  NW 
Washington,  DC  20208 

1  Dr.  Susan  Chlpnan 
Learning  and  Development 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

1  Dr.  John  Mays 

National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

1  Dr.  Arthur  Helmed 
OERI 

1200  19th  Street  NW 
Washington,  DC  20208 

1  Dr.  Andrew  R.  Molnar 
Office  of  Scientific  and  Engineering 
Personnel  and  Education 
National  Science  Foundation 
Washington,  DC  20550 

1  Dr.  Judith  Orasanu 
National  Institute  of  Education 
1200  19th  St.,  N.W. 

Washington,  DC  20208 

1  Dr.  Ramsay  W.  Selden 
National  Institute  of  Education 
1200  19th  St.,  NW 
Washington,  DC  20208 

1  Chief,  Psychological  Reserch  Branch 
U.  S.  Coast  Guard  (G-P-1/2/TP42) 
Washington,  DC  20593 

1  Dr.  Frank  Withrow 
U.  S.  Office  of  Education 
400  Maryland  Ave.  SW 
Washington,  DC  20202 

1  Dr.  Joseph  L.  Young,  Director 
Memory  &  Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 


Private  Sector 

1  Dr.  John  R.  Anderson 
Department  of  Psychology 
Carnegie-Mellon  University 
Pittsburgh,  PA  15213 

1  Dr.  John  Annett 
Department  of  Psychology 
University  of  Warwick 
Coventry  CV4  7AJ 
ENGUND 

1  Dr.  Michael  Atwood 
Bell  Laboratories 
11900  North  Pecos  St. 

Denver,  CO  80234 

1  Psychological  Research  Unit 
Dept,  of  Defense  (Army  Office) 
Campbell  Park  Offices 
Canberra  ACT  2600 
AUSTRALIA 

1  Dr.  Alan  Baddeley 
Medical  Research  Council 
Applied  Psychology  Unit 
15  Chaucer  Road 
Cambridge  CB2  2EF 
ENGLAND 

1  Dr.  Patricia  Baggett 
Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80309 

1  Dr.  Jonathan  Baron 
80  Glenn  Avenue 
Berwyn,  PA  19312 

1  Mr.  Avron  Barr 
Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 

1  Dr.  Menucha  Blrenbaum 
School  of  Education 
Tel  Aviv  University 
Tel  Aviv,  Ramat  Aviv  69978 
Israel 

1  Dr.  John  Black 
Yale  University 
Box  11A,  Yale  Station 
New  Haven.  CT  06520 
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1  Dr.  Lyle  Bourne 

Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80309 


1  Dr.  John  S.  Brown 
XEROX  Palo  Alto  Research  Center 
3333  Coyote  Road 
Palo  Alto,  CA  94304 

1  Dr.  Bruce  Buchanan 
Department  of  Computer  Science 
Stanford  University 
Stanford.  CA  94305 

1  Dr.  Robert  Buhr 
Hubbs/Seaworld  Research  Institute 
University  of  California 
1700  South  Shores  Road,  Mission  Bay 
San  Diego,  CA  92109 

1  Bundmlnisterium  der  Verteidigung 
-Referat  P  II  4- 
Psychological  Service 
Postfach  1328 
D-5300  Bonn  1 
F.  R.  of  Germany 

1  Dr.  C.  Victor  Bunderson 
WICAT  Inc. 

University  Plaza,  Suite  10 
1160  So.  State  St. 

Orem,  UT  84057 

1  Dr.  Jaime  Carbonell 

Carnegie-Mellon  University 
Department  of  Psychology 
Pittsburgh,  PA  15213 

1  Dr.  Pat  Carpenter 
Department  of  Psychology 
Carnegie-Mellon  University 
Pittsburgh,  PA  15213 

1  Dr.  William  Chase 
Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

1  Dr.  William  Clancey 
Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94306 


1  Dr.  Michael  Cole 
University  of  California 
at  San  Diego 

Laboratory  of  Comparative 
Human  Cognition  -  D003A 
La  Jolla,  CA  92093 

1  Dr.  Allan  M.  Collins 
Bolt  Beranek  &  Newman,  Inc. 

50  Moulton  Street 
Cambridge,  MA  02138 

1  Dr.  Lynn  A.  Cooper 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

1  Dr.  Kenneth  B.  Cross 
Anacapa  Sciences,  Inc. 

P.O.  Drawer  Q 

Santa  Barbara,  CA  93)02 

1  LCOL  J.  C.  Eggenberger 
DIRECTORATE  OF  PERSONNEL  APPLIED  RESEAR 
NATIONAL  DEFENCE  HQ 
101  COLONEL  BY  DRIVE 
OTTAWA,  CANADA  K1A 

1  Dr.  Ed  Felgenbaua 
Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 

1  Dr.  Paul  Feltovich 
Department  of  Medical  Education 
Southern  Illinois  University 
School  of  Medicine 
P.O.  Box  3926 
Springfield,  IL  62708 

1  Professor  Reuven  Feuerstein 
HWCRI  Rehov  Karmon  6 
Bet  Hakerem 
Jerusalem 
Israel 

1  Mr.  Wallace  Feurzeig 
Department  of  Educational  Technology 
Bolt  Beranek  &  Newman 
10  Moulton  St. 

Cambridge,  MA  02238 
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Private  Sector 

1  Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville.  MD  20850 

1  Univ.  Prof.  Dr.  Gerhard  Fischer 
Liebiggasse  5/3 
A  1010  Vienna 
AUSTRIA 

1  Dr.  Dexter  Fletcher 
WICAT  Research  Institute 
1875  S.  State  St. 

Orem,  UT  22333 

1  Dr.  John  R.  Frederiksen 
Bolt  Beranek  &  Newnan 
50  Moulton  Street 
Cambridge.  MA  02138 

1  Dr.  Allnda  Friedman 
Department  of  Psychology 
University  of  Alberta 
Edmonton,  Alberta 
CANADA  T6G  2E9 

1  Dr.  Michael  Genesereth 
Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 

1  Dr.  Marvin  D.  Glock 
217  Stone  Hall 
Cornell  University 
Ithaca,  NY  14853 

1  Dr.  Josph  Goguen 
SRI  International 
333  Ravenswood  Avenue 
Menlo  Park.  CA  94025 

1  Dr.  Daniel  Gopher 
Department  of  Psychology 
University  of  Illinois 
Champaign,  IL  61820 

1  Or.  Bert  Green 
Johns  Hopkins  University 
Department  of  Psychology 
Charles  A  34th  Street 
Baltimore,  MD  21218 


Private  Sector 

1  DR.  JAMES  G.  GREENO 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 

1  Or.  Barbara  Hayes-Roth 

^  Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  95305 

1  Dr.  Frederick  Hayes-Roth 
Te knowledge 
525  University  Ave. 

Palo  Alto.  CA  94301 

1  Dr.  Kristina  Hooper 
Clark  Kerr  Hall 
University  of  California 
Santa  Cruz,  CA  95060 

1  Glenda  Greenwald,  Ed. 

Human  Intelligence  Newsletter 
P.  0.  Box  1163 
Birmingham,  MI  48012 

1  Dr.  Earl  Hunt 
Dept,  of  Psychology 
University  of  Washington 
Seattle,  HA  98105 

1  Dr.  David  Kieras 
Department  of  Psychology 
University  of  Arizona 
Tuscon,  AZ  85721 

1  Dr.  Walter  Kintsch 
Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80302 

1  Dr.  Stephen  Kosslyn 
Department  of  Psychology 
Brandeis  University 
Waltham,  MA  02254 

1  Dr.  Pat  Langley 
Carnegie-Mellon  University 
Pittsburgh,  PA  15213 
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Private  Sector 

1  Dr.  Marcy  Lanaman 
The  L.  L.  Thurstone  Psychometric 
Laboratory 

University  of  North  Carolina 
Davie  Hall  01 3A 
Chapel  Hill,  NC  27514 

1  Dr.  Jill  Larkin 
Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

1  Dr.  Alan  Lesgold 
Learning  R&D  Center 
University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15260 


1  Dr.  Jim  Levin 
University  of  California 
at  San  Diego 

Laboratory  fof  Comparative 
Human  Cognition  -  D003A 
La  Jolla,  CA  92093 

1  Or.  Michael  Levine 
Department  of  Educational  Psychology 
210  Education  Bldg. 

University  of  Illinois 
Champaign,  IL  61801 

1  Dr.  Marcia  C.  Linn 
University  of  California 
Director,  Adolescent  Reasoning  Project 
Berkeley,  CA  94720 


1  Dr.  Jay  McClelland 
Department  of  Psychology 
MIT 

Cambridge,  MA  02139 

1  Dr.  James  R.  Miller 
Texas  Instrunents,  Inc. 
Central  Research  Laboratory 
P.  0.  Box  226015,  MS238 
Dallas,  TX  75266 


1  Dr.  Mark  Miller 
Computer  Thought  Corporation 
1721  West  Plane  Parkway 
Plano,  TX  75075 


Private  Sector 

1  Dr.  Allen  Munro 

Behavioral  Technology  Laboratories 
1845  Elena  Ave.,  Fourth  Floor 
Redondo  Beach,  CA  90277 

1  Dr.  Donald  A  Norman 
Cognitive  Science,  C-015 
Univ.  of  California,  San  Diego 
U  Jolla,  CA  92093 

1  Committee  on  Human  Factors 
JH  811 

2101  Constitution  Ave.  NW 
Washington,  DC  20418 

1  Dr.  Jesse  Orlansky 
Institute  for  Defense  Analyses 
1801  N.  Beauregard  St. 

Alexandria,  VA  22311 

1  Dr.  Seymour  A.  Papert 
Massachusetts  Institute  of  Technology 
Artificial  Intelligence  Lab 
545  Technology  Square 
Cambridge,  MA  02139 

1  Dr.  James  A.  Paulson 
Portland  State  University 
P.O.  Box  751 
Portland,  OR  97207 

1  Dr.  James  W.  Pellegrino 
University  of  California, 

Santa  Barbara 
Dept,  of  Psychology 
Santa  Barabara,  CA  93106 

1  Dr.  Nancy  Pennington 
University  of  Chicago 
5801  S.  Ellis  Avenue 
Chicago,  IL  60637 

1  Mr.  L.  Petrullo 
2431  N.  Edgewood  Street 
ARLINGTON,  VA  22207 

1  DR.  PETER  POLSON 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  COLORADO 
BOULDER,  CO  80309 
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Private  Sector  Private  Sector 


1  Dr.  Fred  Reif 
Physics  Department 
University  of  California 
Berkeley,  CA  9^720 

1  Dr.  Lauren  Resnick 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  1521 

1  Mary  S.  Riley 
Program  in  Cognitive  Science 
Center  for  Human  Information  Processing 
University  of  California,  San  Diego 
La  Jolla,  CA  92093 

1  Dr.  Andrew  M.  Rose 
American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NW 
Washington,  DC  20007 

1  Dr.  Ernst  Z.  Rothkopf 
Bell  Laboratories 
Murray  Hill,  NJ  07974 

1  Dr.  William  B.  Rouse 
Georgia  Institute  of  Technology 
School  of  Industrial  &  Systems 
Engineering 
Atlanta,  GA  30332 

1  Dr.  David  Rumelhart 
Center  for  Human  Information  Processing 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

1  Dr.  Michael  J.  Samet 
Perceptronics,  Inc 
6271  Variel  Avenue 
Woodland  Hills.  CA  91364 

1  Dr.  Roger  Schank 
Yale  University 
Department  of  Computer  Science 
P.O.  Box  2158 
New  Haven,  CT  06520 

1  Dr.  Walter  Schneider 
Psychology  Department 
603  E.  Daniel 
Champaign,  IL  61820 


1  Dr.  Alan  Schoenfeld 
Mathematics  and  Education 
The  University  of  Rochester 
Rochester,  NY  14627 

1  DR.  ROBERT  J.  SEIDEL 
INSTRUCTIONAL  TECHNOLOGY  GROUP 
HUMRRO 

300  N.  WASHINGTON  ST. 

ALEXANDRIA.  VA  22314 

1  Mr.  Colin  Sheppard 
Applied  Psychology  Unit 
Admiralty  Marine  Technology  Est. 
Teddington,  Middlesex 
United  Kingdom 

1  Dr.  H.  Wallace  Sinaiko 
Program  Director 

Manpower  Research  and  Advisory  Services 
Smithsonian  Institution 
801  North  Pitt  Street 
Alexandria.  VA  22314 

1  Dr.  Edward  E.  Smith 
Bolt  Beranek  &  Nevnan,  Inc. 

50  Moulton  Street 
Cambridge,  MA  02138 

1  Dr.  Richard  Snow 
School  of  Education 
Stanford  University 
Stanford,  CA  94305 

1  Or.  Eliott  Soloway 
Yale  University 
Department  of  Computer  Science 
P.O.  Box  2158 
New  Haven,  CT  06520 

1  Dr.  Kathryn  T.  Spoehr 
Psychology  Department 
Brown  University 
Providence,  RI  02912 

1  Dr.  Robert  Sternberg 
Dept,  of  Psychology 
Yale  University 
Box  11A,  Yale  Station 
New  Haven,  CT  06520 
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Private  Sector 

1  Dr.  Albert  Stevens 
Bolt  Beranek  &  Newnan,  Inc. 

10  Moulton  St. 

Cambridge,  MA  02238 

1  David  E.  Stone,  Ph.D. 

Hazeltlne  Corporation 
7680  Old  Sprlnghouse  Road 
McUan,  VA  22102 

1  DR.  PATRICK  SUPPES 
INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 

1  Dr.  Klkumi  Tatsuoka 
Computer  Based  Education  Research  Lab 
252  Engineering  Research  Laboratory 
Urban a,  IL  61801 

1  Dr.  Perry  W.  Thorndyke 
Perceptronlcs,  Inc. 

545  Middlefleld  Road,  Suite  140 
Menlo  Park,  CA  94025 

1  Dr.  Douglas  Tovme 
Univ.  of  So.  California 
Behavioral  Technology  Labs 
1845  S.  Elena  Ave. 

Redondo  Beach,  CA  90277 

1  Dr.  Kurt  Van  Lehn 
Zerox  PARC 

3333  Coyote  Hill  Road 
Palo  Alto,  CA  94304 


1  DR.  GERSHON  WELTMAN 
PERCEPTRONICS  INC. 

6271  VARIEL  AVE. 

WOODLAND  HILLS,  CA  91367 

1  Dr.  Keith  T.  Wescourt 
Perceptronlcs,  Inc. 

545  Middlefleld  Road,  Suite  140 
Menlo  Park,  CA  94025 

1  William  B.  Whitten 
Bell  Laboratories 
20-610 

Holmdel,  NJ  07733 


Private  Sector 

1  Dr.  Christopher  Wlckens 
Department  of  Psychology 
University  of  Illinois 
Champaign,  IL  61820 

1  Dr.  Mike  Williams 
Zerox  PARC 

3333  Coyote  Hill  Road 
Palo  Alto,  CA  94304 


